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Executive  Summary 


Problem  Definition  The  Block  III  Apache  is  a  modernized  version  of  the  currently  fielded  AH-64D  Block 

II  Apache  aircraft.  The  design  incorporates  technology  advancements  harvested  from  other  development 
programs  and  advances  in  processing  technology  since  the  fielding  of  the  Block  I  and  II  AH-G4D  Apache. 
One  of  the  major  upgrades  contained  in  the  Block  III  Apache  configuration  is  the  provision  of  control  systems 
for  Unmanned  Aircraft  Systems  (UAS).  UAS  with  Tactical  Common  Data  Link  (TCDL)  integration  will 
provide  the  aircraft  crew  with  capability  of  level  IV  control  of  UASs,  allowing  the  aircraft  to  control  a  UAS 
and  immediately  relay  and  receive  UAS  data. 

Concerns  have  been  expressed  over  the  employment  and  fielding  of  this  new  technology  by  the  Apache  Block 

III  crew  and  the  UAS  team  under  combat  conditions:  to  include  training,  education,  and  communications. 
This  study  is  helping  Army  leaders  address  the  issues  related  to  cooperative  engagements  and  levels  of 
interoperability  between  UAS  and  AH-64D  Apache  Longbow  aircraft..  Currently,  aviators  get  time-delayed 
verbal  reports  of  UAS  reconnaissance  (Level  1  control).  Systems  exist  to  provide  a  real-time  payload  feed 
(Level  2).  The  Army  program  managers  for  UAS  and  for  Apache  helicopters  are  interested  in  whether  it 
will  be  beneficial  to  provide  actual  control  of  the  payload  (Level  3)  or  control  of  the  unmanned  aerial  vehicle 
itself  (Level  4)  to  an  aviator  in  his  or  her  cockpit.  There  are  a  variety  of  individuals  and  organizations  that 
have  a  vested  interest  in  this  problem  and  its  solution. 


Technical  Approach  The  approach  consisted  of  three  integrated  efforts: 

1.  Experimentation  with  rated  AH-64D  helicopter  pilots  in  the  Risk  Assessment  Cost  Reduction  Simulator 
(RACRS)  to  determine  the  value  and  change  in  crew  workload  due  to  Video  from  Unmanned  air  systems  for 
Interoperability  Teaming  Level  II  (VUIT-2),  a  system  currently  being  installed  in  Block  II  Apache  Aircraft. 

2.  Experimentation  using  a  lower  resolution  game-based  simulation.  Virtual  Battlespace  2  (VBS2),  to  provide 
insight  as  to  whether  this  type  of  environment  can  represent  and  validate  experimentation  conducted  in  a 
much  higher  resolution  and  more  expensive  environment  such  as  the  RACRS.  Through  subjective  and 
objective  measures  this  experiment  was  designed  to  identify  whether  there  are  significant  differences  in  a 
pilots  performance,  workload,  and  situational  awareness  between  level  I  and  level  II  interoperability  with  a 
UAS. 

3.  Using  fundamental  systems  analysis  techniques  such  as  stakeholder  and  functional  analysis  combined 
with  Human  Factors  and  Accident  Classification  and  risk  management  techniques  develop  a  prioritized  list 
of  recommended  controls  to  reduce  the  risk  of  mission  failure  during  cooperative  engagements  between 
manned  and  unmanned  aircraft  systems. 


Results  1.  During  experimentation  in  the  RACRS.  with  no  statistically  significant  increase  in  workload, 
pilots  reported  that 

a.  It  was  easier  for  to  detect  and  engage  targets  using  the  VUIT-2  due  to  the  steep  visual  aspect 
angle  compared  to  the  Target  Acquisition  Designation  Sight  (TADS) 

b.  Situation  awareness  provided  by  the  VUIT-2  reduced  the  time  required  to  detect  and  engage 
targets 
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c.  There  were  more  tasks  to  complete,  due  to  the  additional  sensor,  but  there  was  more  time  to 
complete  target  detection  and  engagement  tasks  because  of  the  greater  stand-off  range. 

d.  During  the  entire  experiment  the  Bedford  workload  ratings  elicited  through  surveys  and  subject 
matter  exports  stayed  well  below  the  threshold  established  in  the  Apache  Block  III  capability 
development  document  (CDD). 

2.  The  low  resolution  experiment  enabled  the  analysts  to  reject  the  null  hypothesis  that  there  was  no  differ¬ 
ence  in  the  mean  response  for  performance,  workload,  and  situational  awareness.  Factors  ill  all  three  areas 
indicated  improvements  in  those  areas,  basically  the  same  results  that  were  found  in  the  higher  resolution 
environment  in  the  RACRS. 

3.  A  Prioritized  list  of  recommendations  and  considerations  concerning  cooperative  engagements  was  pro¬ 
vided  to  the  client.  Controls  address  all  elements  of  doctrine,  organization,  training,  materiel,  logistics, 
personnel,  and  facilities  (DOTMLPF  )  and  identified  opportunities  to  reduce  the  risk  of  mission  failure. 

The  client  expressed  interest  in  sharing  these  findings  with  Department  of  Defense  (DoD)  Aviation  lead¬ 
ership  and  directed  that  two  of  the  recommendations  be  pursued  immediately;  he  encouraged  a  continued 
relationship  with  West  Point  and  the  program  managers  for  Apache  and  UAS.  The  two  recommendations 
that  will  be  immediately  addressed  are: 

a.  The  development  of  an  Army  virtual  training  system  similar  to  the  Marines'  Deployable  Virtual 
Training  Environment  (DVTE).  This  will  address  a  training  gap  at  the  individual,  team,  and 
unit  levels,  and  will  lead  to  improved  RACRS.  Longbow  Crew  Trainer  (LCT).  and  BDF  TOC 
simulation  capabilities. 

b.  Development  of  a  Cooperative  engagements  leaders  training  guide  to  provide  essential  informa¬ 
tion  to  commanders  and  staffs  regarding  rnanned/unmanned  cooperative  engagements  in  the 
operational  environment.  This  handbook  is  intended  to  be  a  quick-reference  for  military  com¬ 
manders  at  Brigade-level  and  below  to  employ  this  unique  asset. 
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1  INTRODUCTION 


1  Introduction 

This  study  outlines  efforts  by  the  Operations  Re¬ 
search  Center,  in  the  West  Point  Department  of  Sys¬ 
tems  Engineering,  to  look  into  some  of  the  consid¬ 
erations  for  integrating  UAS  video  into  the  Apache 
cockpit  in  order  to  support  cooperative  engagements 
between  UAS  and  attack  helicopters.  In  these  co¬ 
operative  engagements,  the  UAS  initially  detects  the 
target.  A  tactical  operations  center  then  does  coor¬ 
dination  with  pre-planned  or  dynamically  re-tasked 
aviation  assets  to  move  to  the  target  area  and  engage 
the  target.  As  the  UAS  hands  off  the  target,  the  abil¬ 
ity  to  view  the  UAS  video  inside  the  Apache  cockpit 
supports  a  faster  and  more  reliable  target  acquisition 
with  greater  situation  awareness  of  the  target  area. 
This  study  addresses  concerns  about  the  cognitive 
workload  this  additional  video  places  on  the  pilots. 
It  also  addresses  some  of  the  factors  associated  with 
overall  success  of  cooperative  engagements.  This  sec¬ 
ond  portion  of  the  study  included  a  deployment  into 
Iraq  and  Afghanistan  to  do  detailed  stakeholder  anal¬ 
ysis  and  functional  analysis  in  order  to  better  un¬ 
derstand  cooperative  engagements  and  the  potential 
challenges  they  pose  for  all  elements  of  this  systems 
of  systems  integration. 

1.1  System  Description 

Specifically,  this  study  addresses  the  system  of  sys¬ 
tems  integration  between  the  Apache  helicopter  and 
Army  UAS  using  the  VUIT-2  interface. 

1.1.1  The  Block  III  Apache 

The  Block  III  Apache  is  a  modernized  version  of 
the  currently  fielded  AH-64D  Block  II  Apache  air¬ 
craft.  The  design  incorporates  technology  advance¬ 
ments  harvested  from  other  development  programs 
and  advances  in  processing  technology  since  the  field¬ 
ing  of  the  Block  I  and  II  AH-G4D  Apache  (Figure  1). 
The  planned  upgrades  will  result  in  improved  aircraft 
performance,  reduced  operating  costs,  and  improved 
mission  performance. 


Fig.  1:  AH-61D  Apache  Aircraft 


The  backbone  of  the  upgrade  package  is  the  replace¬ 
ment  of  obsolescent  processing  hardware  with  up¬ 
dated  Mission  Processors  (MP)  and  Aircraft  Interface 
Units  (AIU).  This  modernized  processing  capability 
supports  several  new  and  enhanced  system  upgrades. 

One  of  the  major  upgrades  contained  in  the  Block  III 
Apache  configuration  is  the  provision  of  control  sys¬ 
tems  for  Unmanned  Aircraft  Systems  (UAS).  UAS 
with  Tactical  Common  Data  Link  (TCDL)  integra¬ 
tion  will  provide  the  aircraft  crew  with  capability  of 
level  IV  control  of  UASs.  allowing  the  aircraft  to  con¬ 
trol  a  UAS  and  immediately  relay  and  receive  UAS 
data. 

1.1.2  Unmanned  Aircraft  Systems 

UAS  operations  support  battlefield  commanders  and 
their  staffs  as  they  plan,  coordinate,  and  execute 
operations.  UAS  increase  the  situational  awareness 
(SA)  of  commanders  through  intelligence,  surveil¬ 
lance.  and  reconnaissance  (ISR).  Armed  UAS  provide 
commanders  direct  fire  capabilities  to  prosecute  the 
close  fight  and  influence  shaping  of  the  battlefield. 
Army  UAS  can  perform  some  or  all  of  the  follow¬ 
ing  functions:  enhanced  targeting  through  acquisi¬ 
tion.  detection,  designation,  suppression  and  destruc¬ 
tion  of  enemy  targets,  and  battle  damage  assessment 
(BDA).  Other  UAS  missions  support  the  maneuver 


1 


Cooperative  Engagements  Between  UAS  and  AH-64D 


commander  by  contributing  to  the  effective  tactical 
operations  of  smaller  units.  Ground  Control  Sta¬ 
tions  (GOS)  with  common  data  links,  remote  video 
terminals  (RYTs)  and  remote  operations  video  en¬ 
hanced  receiver  (ROYER),  portable  ground  control 
stations  (PGCSs).  and  Army  helicopter  \rmy  air¬ 
borne  command  and  control  system  (A2C2S)  I  AS 
teaming  will  enhance  SA  and  the  common  opera¬ 
tional  picture  (COP),  helping  to  set  the  conditions 
for  operational  success  (FM  3-0*4.15*).  200C). 

There  are  th ree  classes  of  U  \S:  man-portable,  tacti¬ 
cal,  and  theater.  The  four  different  types  of  UAS  the 
Army  uses  to  conduct  operations  are: 

•  Improved  Gnat  (1-Gnat)  (RQ-1L). 

•  Hunter  (RQ-5  MQ-5)* 

•  Shadow  (RQ-7). 

•  Raven  (RQ-  1  1 ). 

Although  all  UAS  capabilities  were'  considered  dur¬ 
ing  tins  study  the  primary  UAS  was  the  tactical  I  AS 
(Tt  \S)  Shadow  based  on  its  mission,  capabilities 
and  current  nse  and  integration  in  Brigade  Combat 
Team  (BUT)  operations  deployed  in  OFF  and  OIF 
(Figure  2)  (Department  of  Defense.  2007). 

The  Shadow  200  is  a  small,  lightweight  TU  \S  de¬ 
signed  as  a  ground  maneuver  Commanders  primary 
day  or  night  reconnaissance,  surveillance,  target  ac¬ 
quisition  system  The  Shadow  200  employment  is 
flexible  and  (’an  he  tailored  to  support  operations 
down  to  company  or  squad  level.  The  TUAS  also 
greatly  enhances  force  protection  with  its  on  station 
loitering  ability  and  high-resolution  sensors.  \s  a 
command  and  control  enabler  for  tactical  decision 
making,  it  ’s  the  commanders  "dominant  eye”,  allow¬ 
ing  him  to  shape  the  battlefield  to  ensure  mission 
success. 

1.1.3  VUIT-2 

The  Video  from  UAS  for  Interoperability  Team¬ 
ing  Level  II  (\T  IT-2)  system  is  designed  to  en¬ 
hance  interoperability  between  the  UAS  and  the  AH- 
GID.  This  is  accomplished  by  providing  (real  time) 


Fig,  2:  Launching  the  Shadow  I  \\ 


streaming  video  from  a  l  \S  sensor  to  the  AH- 
6 ID  crew  and  allowing  the  crew  to  i ('-transmit  that 
video  or  "ownship"  target  acquisition  designation 
sight  modified-target  acquisition  designation  sight 
(TADS  M-TADS)  video  to  a  ground  unit  equipped 
with  a  man-portable  one  system-remote  video  termi¬ 
nal  (OSRYT)  or  to  another  airborne  OSRYT.  The 
flow  of  information  between  the  UAS.  \H-  GIT),  and 
OSRYT  is  depicted  in  Figure  3  (Hicks  o(  ah.  2008). 

The  majot  components  of  the  YUIT-2  system  on 
the  AH-  GID  ate:  a  mast-monnlocl  C  L-hand  omni¬ 
directional  antenna  for  reception  of  U  AS  video  and  an 
ultra  high  frequency  (I  HF)  antenna  for  reception  of 
UAS  metadata:  an  OSRYT  and  Thermite  computer 
to  process  received  video  for  presentation  on  t  he  crow 
member  selected  multipurpose  display  (MPD)  (Fig¬ 
ure'  I):  keyboard  style  control  that  permits  the  copilot 
gunner  (CPG)  to  interface'  with  the*  YUJT-2  system: 
a  mini-tactical  common  data  link  (MTCDL)  system 
that  permits  transmission  of  received  UAS  ot  'own- 
ship"  TADS  M-TADS  video  to  a  ground  or  airborne 
OSRYT.  The  YU1T-2  is  incorporated  as  a  strap-on 
system  for  Block  1  and  11  AH-GIDs  involving  min¬ 
imal  interface  with  the  current  production  aircraft 
hns  architecture.  The  video  signal  generated  by  the' 
Thermite  compute!  shares  the  line-out.  of  the  aircraft 
video  playback  system  between  the  recorder  and  the 
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Fig  3:  VUIT-2  information  flow. 


MPD  requiring  the  aircraft  video  recorder  to  be  in 
playback  mode  to  view  UAS  video. 

1.1.4  System  of  Systems 

There  are  a  number  of  definitions  of  a  system  of  sys¬ 
tems.  for  example: 

“. . .  an  integrated  force  package  of  in¬ 
teroperable  systems  acting  as  a  single  sys¬ 
tem  to  achieve  a  mission  capability.  Typical 
characteristics  include  a  high  degree  of  col¬ 
laboration  and  coordination,  flexible  addi¬ 
tion  or  removal  of  component  systems,  and  a 
net-centric  architecture...’*  (Assistant  Sec¬ 
retary  of  the  Navy  for  Research.  Develop¬ 
ment.  and  Acquisition.  2006) 

. .  a  set  or  arrangement  of  systems 
that  results  when  independent  and  useful 
systems  are  integrated  into  a  larger  system 
that  delivers  unique  capabilities...’*'  (dod. 
2004) 

“[Systems]  of  systems  exist  when  there 
is  a  presence  of  a  majority  of  the  following 


five  characteristics:  operational  and  man¬ 
agerial  independence,  geographical  distribu¬ 
tion,  emergent  behavior,  and  evolutionary 
development.’’  (Sage  and  Cuppan.  2001) 

The  system  of  systems  identified  for  this  research  ef¬ 
fort  depicts  a  system  boundary  around  the  interac¬ 
tions  between  a  UAS  and  AH-64D  during  a  coopera¬ 
tive  engagement.  Figure  5. 

Regardless  of  the  definition  used,  the  characteristics 
of  a  cooperative  engagement  between  manned  and 
unmanned  systems  lead  the  analyst  to  conclude  that 
it  is  a  system  of  systems: 

•  Air  space  management  and  safety  achieved  by 
all  component  systems  working  together 

•  Individual  systems  provide  useful  services  (fire 
power,  real  time  video) 

•  Individual  systems  are  acquired  independently 
with  different  contractors 

•  Individual  systems  come  and  go  routinely 

•  Highly  network  centric 
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Fig.  4  YUIT-2  layout. 
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Fig  5;  Cooperative  engagements  system  of  systems. 
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2  BACKGROUND 


Fig-  6:  Levels  of  interoperability. 


•  Standard  protocols  and  interfaces 

•  Geographically  dispersed 

•  System  complexity  leads  to  emergent  behavior 

•  Extensive  coordination  is  central  to  achieving 
high  levels  of  efficiency  and  safety 

Although  these  characteristics  provide  great  capabil¬ 
ity  to  the  system,  they  also  expose  the  system  to  high 
risk  vulnerabilities  that  must  be  addressed. 

1.2  Problem 

Concerns  have  been  expressed  over  the  employment 
and  fielding  of  the  technology  that  would  provide 
an  AH-61D  crew  different  levels  of  interoperability 
(sometimes  referred  t  o  as  levels  of  control):  to  include 
issues  surrounding  training,  education,  and  commu¬ 
nications  between  the  manned  and  unmanned  crews. 
The  interaction  between  these  crews  is  referred  to  as 
cooperative  engagements;  during  those  engagements 
t  he  crews  will  experience  different  levels  of  interop¬ 
erability  (Figure  6).  Currently,  aviators  get  time- 
delayed  verbal  reports  of  UAS  reconnaissance  (Level 
1  control).  Systems  exist  to  provide  a  real-time  pay- 
load  feed,  or  live  video  (Level  2).  The  Block  III  Long¬ 
bow  will  have  integrated  capabilities  for  the  crew  to 
obtain  act  ual  control  of  the  payload  (Level  3)  or  con¬ 
trol  of  the  unmanned  aerial  vehicle  itself  (Level  I). 
There  are  a  variety  of  individuals  and  organizations 
that  have  a  vested  interest  in  this  problem  and  its 
solution.  This  research  will  not  address  Level  V  con¬ 
trol. 


2  Background 

In  October  2000.  the  Training  and  Doctrine  Com¬ 
mand  (TRADOC)  System  Manager  (TSM).  now 
designated  as  the  TRADOC  Capabilities  Manager 
(TCM)  explored  the  volumes  of  UAS  analyses  that 
had  been  conducted  over  the  years. 

•  Army  Aviation  Unmanned  Aerial  Vehicle  Study 
(1993) 

•  Assessment  Of  Non-Lethal  Unmanned  Aerial  Ve¬ 
hicle  Integration  with  Combat  \viation  Missions 
Study  (1991) 

•  Birddog  Advanced  Technology  Demonstration 
(ATD)  (1995) 

•  Global  Wargarne  ‘90  97  (1990  1997) 

•  Boeing  Manned  Unmanned  Teaming  Concept 
(1997) 

•  Manned  and  Unmanned  Aerial  Plat  form  Opera¬ 
tions  on  the  Digitized  Battlefield  (MUM  I)  Con¬ 
cept  Experimentation  Program  (CEP)  (1997) 

•  Analysis  Of  Comanche  Helicopter  Its  Con¬ 
tribution  As  An  Aerial  Armed  Reconnaissance 
Platform  Study  (Vector  Research.  Inc.  1997) 

•  Manned  and  Unmanned  Aerial  Platform  Opera¬ 
tions  on  the  Digitized  Battlefield  (MI  M  11)  Con¬ 
cept  Experimentation  Program  (CEP)  (1998) 

•  Congressional  Budget  Office  Paper  Titled:  Il¬ 
lustrative  Options  for  DOD's  UAV  Programs 
(1998) 

•  Apache  -  Hunter  Quick  Reaction  Contingency 
Program  (1999) 

•  UAV  Employment  in  Kosovo.  Lesson  Learned  - 
U.S.  Army  (1999) 

•  Army  After  Next  (A  \N)  Manned  \nd  I  n- 
manned  Teaming  Control  (Reconnaissance'  and 
Lethal  UAV)  Advanced  Concepts  And  Technol¬ 
ogy  II  (ACT  II)  Program  (1999-00) 
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•  Manned  and  Unmanned  Aerial  Platform  Op¬ 
erations  on  the  Digitized  Battlefield  (MUM 

III)  Concept  Experimentation  Program  (CEP) 
(1999-00) 

•  Apache  Video  and  Image  Transmission  System 
(AVITS)  (1999-00) 

•  Airborne  Manned/Unmanned  System 
(AMUST)  Program  (1999-00) 

•  Manned  and  Unmanned  Aerial  Platform  Op¬ 
erations  on  the  Digitized  Battlefield  (MUM 

IV)  Concept  Experimentation  Program  (CEP) 
(2001-02) 

•  3/21/95  RAH  66  Acquisition  Decision  Memoran¬ 
dum  (ADM) 

•  7/27/98  OIPT  Comanche  Program  Restructure 

•  7/29/99  RAH  66  Comanche  Analysis  of  Alterna¬ 
tives  (AoA)  Studies  and  Analysis  Group  (SAG) 
Meeting  (29  Jun.  99) 

•  9/99  Outline  of  Operational  Concept  for  Co¬ 
manche  and  UAV 

•  10/18/99  RAH  66  Comanche  AoA  SAG  Meeting 
(8  Nov.  99) 

•  4/7/00  RAH  66  Acquisition  Decision  Memoran¬ 
dum  (ADM) 

Most  recently,  as  the  design  of  the  Apache  Block  III 
moves  forward,  an  experiment  was  conducted  in  the 
Risk  and  Cost  Reduction  System  (RACRS)  simula¬ 
tor  to  examine  the  workload  placed  on  pilots  as  the 
Block  III  technology  is  integrated  into  flight  opera¬ 
tions  (Hicks  et  ah.  2008). 

The  TSMs  findings  are  summarized  in  an  executive 
summary  below  (avi.  2000): 

“The  initial  exploration  of  UAVs  oper¬ 
ating  with  air  maneuver  platforms/systems 
began  with  aviation's  participation  in 
the  Joint  Precision  Strike  Demonstra¬ 
tion  (JPSD)  in  1992.  A  proposed  Ad¬ 
vanced  Concept  Technology  Demonstration 


(ACTD)  Survivable  Armed  Reconnaissance 
on  the  Digitized  Battlefield  followed  the 
JPSD  effort  with  the  intent  of  integrating 
Comanche  and  UAV  as  a  “system  of  sys¬ 
tems’*'.  This  ACTD  candidate  was  not  able 
to  acquire  funding  to  go  beyond  the  plan¬ 
ning  stage.  In  1993  the  Aviation  Warfight¬ 
ing  Center  began  to  explore  the  possible 
synergy  gained  from  integrating  manned 
and  unmanned  capabilities  in  pursuit  of 
a  common  objective.  The  results  of  this 
multi-year  effort,  along  with  a  number  of 
other  studies/experiments,  make  up  the  in¬ 
formation  contained  in  the  blue  book. 

The  studies  and  experiments  conducted 
by  the  Aviation  Warfighting  Center  were 
able  to  explore  each  of  the  five  levels  of  UAV 
control.  The  findings  from  these  studies  in¬ 
dicate  that  additional  assistance  from  ad¬ 
vanced  technologies  will  be  required:  other¬ 
wise  levels  4  and  5  controls  exceed  the  ca¬ 
pability  of  a  two-man  crew.  The  following 
are  insights  gained  from  our  past  efforts: 

a.  A  definite  war  fighting  synergy  is 
gained  when  manned  and  unmanned  sys¬ 
tems  combine  to  accomplish  a  common  ob¬ 
jective.  One  of  the  unique  contributions  of 
the  UAV  system  in  the  reconnaissance  en¬ 
vironment  is  that  of  tactical  surveillance. 
Prior  to  the  manned  and  unmanned  ex¬ 
periments  a  tactical  surveillance  capability 
was  not  available  to  integrate  with  Divi¬ 
sion/Corps  aviation  reconnaissance  organi¬ 
zations.  A  tactical  surveillance  capability 
integrated  with,  and  directly  responsive  to. 
the  aviation  reconnaissance  organizations 
greatly  enhance  our  current  Division/Corps 
ground  and  air  maneuver  reconnaissance  ca¬ 
pability. 

b.  The  integration  of  information  (pilot- 
vehicle  interface)  within  the  cockpit  from  an 
off  board  sensor  must  be  accomplished  in  a 
manner  similar  to  the  integration  of  infor¬ 
mation  utilized  from  the  on-board  sensors. 
Without  similar  processes  the  crew  rapidly 
becomes  task  loaded  (saturated)  and  in 
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2  BACKGROUND 


some  cases  can  become  disoriented. 

c.  UAV  observation  and  surveillance  ca¬ 
pabilities  are  complementary  to  and  not  a 
replacement  for  manned  air  maneuver  re¬ 
connaissance  capabilities. 

d.  The  presentation  and  understanding 
of  information  gained  from  sensors  located 
in  different  spatial  positions  and  different 
geographical  areas  on  the  battlefield  will  re¬ 
quire  further  definition  and  exploration. 

e.  Virtual  simulation  tools,  which  repli¬ 
cate  the  manned  and  unmanned  capabili¬ 
ties.  must  be  enhanced.  Greater  virtual 
simulation  resolution  for  visual  sensor  in¬ 
formation  (current  and  projected)  is  re¬ 
quired  to  more  effectively  examine  the  de¬ 
gree  to  which  manned  and  unmanned  sys¬ 
tems  should  be  integrated  in  the  conduct  of 
tactical  reconnaissance  missions. 

f.  Advanced  technology  must  be  inte¬ 
grated  into  the  manned  and  unmanned  sys¬ 
tems  (ground  and  air)  to  assist  the  manned 
crew  in  command  and  control  of  the  un¬ 
manned  system.  Continuation  of  Combat 
System  Crew  Associate  (formerly  Rotor- 
craft  Pilots  Associate).  Apache  Video  and 
Image  Transmission  System  (AVITS)  and 
Airborne  Manned  and  Unmanned  System 
Technology  (A MUST)  programs  are  essen¬ 
tial  to  help  define  and  advance  the  technol¬ 
ogy  necessary  for  crews  to  effectively  imple¬ 
ment  UAV  control  levels  4  and  5. 

g.  The  integration  of  manned  and  un¬ 
manned  system  concepts,  as  defined  over 
the  past  eight  years,  identified  five  areas 
that  require  additional  emphasis  and  anal¬ 
ysis.  First,  what  are  the  Tactics.  Tech¬ 
niques  and  Procedures  and  advanced  tech¬ 
nology  applications,  which  allow  the  un¬ 
manned  system  a  reasonable  survivability 
rate?  Second,  which  UAV  organization  is 
best  suited  for  conducting  tactical  recon¬ 
naissance  operations  integrated  with  air  ma¬ 
neuver  systems  and  where  should  that  or¬ 
ganization  be  assigned?  Third,  what  is 
the  operational  significance  of  a  fixed  wing 


UAV  versus  a  Vertical  Take  Off  and  Landing 
(VTOL)  UAV  operating  with  or  assigned 
to  an  aviation  brigade/battalion  organiza¬ 
tion?  Fourth,  as  a  result  of  the  experimen¬ 
tation  conducted  to  date  is  there  a  strong 
case  for  the  Army  having  both  a  close  and 
short  range  tactical  UAV?  Fifth,  what  is  the 
impact  of  Military  Operations  in  Urban  Ter¬ 
rain  (MOUT)  on  the  integration  of  manned 
and  unmanned  systems  (ground  and  air)  in 
particular  UAVs  and  air  maneuver  systems? 

h.  Simulation  cannot  completely  dupli¬ 
cate  live  exercises  or  experimentation.  Live 
interaction  between  manned  and  unmanned 
platforms  ground  and  air  will  be  essential 
to  capture  real  world  lessons  learned  and 
to  provide  a  complete  definition  of  required 
capabilities.  Shortly  after  the  decision  to 
cancel  the  Hunter  Tactical  UAV  Program  a 
number  of  the  Hunter  Systems  were  placed 
in  storage.  In  order  to  conduct  live  experi¬ 
mentation  and  advance  the  concept  of  aerial 
manned  and  unmanned  platform  integra¬ 
tion.  a  Hunter  platoon  or  company  should 
be  fielded  to  a  division  aviation  brigade  for 
a  period  of  two  years.  During  this  time  pe¬ 
riod  UAV  and  manned  systems  would  oper¬ 
ate  together  as  a  team  and  help  the  Army 
define  the  degree  to  which  manned  and  un¬ 
manned  systems  should  be  integrated.’5 

Most  of  these  findings  were  used  to  recommend  UAV 
requirements  to  the  TSM  for  integration  into  the 
Army  UAV  program.  The  positive  experience  with 
the  use  of  simulation  has  been  an  effective  means  to 
help  develop  requirements  but  has  not  been  trans¬ 
ferred  into  crew  and  unit  training  capabilities. 

Thus  in  1993  The  Army  established  the  need  for  this 
type  of  system  (UAS.  and  manned  levels  of  interop¬ 
erability)  and  has  been  developing  the  system  from 
1997  to  present.  Currently,  as  the  development  and 
production  of  the  Block  III  Apache  moves  forward, 
the  cooperative  engagements  system  is  concurrently 
in  four  stages  of  its  life  cycle: 

•  design  and  development 


Cooperative  Engagements  Between  UAS  and  AH-64D 


•  production 

•  deployment,  and 

•  system  operation 

This  presents  significant  additional  strains  on  an  ad- 
ready  complex  system. 

3  Technical  Approach 

The  approach  consists  of  three  integrated  efforts: 

1.  Experimentation  with  rated  AH-61D  helicopter 
pilots  in  the  Risk  Assessment  Cost  Reduction 
Simulator  (RACRS)  to  determine  the  value  and 
change  in  crew  workload  due  to  Video  from  Un¬ 
manned  air  systems  for  Interoperability  Teaming 
Level  II  (VUIT-2).  a  system  currently  being  in¬ 
stalled  in  Block  II  Apache  Aircraft. 

2.  Experimentation  using  lower  resolution  software. 
Virtual  Battle  Station  2  (VBS2).  to  provide  in¬ 
sight  as  to  whether  this  type  of  environment 
can  represent  and  validate  experimentation  con¬ 
ducted  in  a  much  higher  resolution  and  more 
expensive  environment  such  as  the  RACRS. 
Through  subjective  and  objective  measures  this 
experiment  was  designed  to  identify  whether 
there  are  significant  differences  in  a  pilots  per¬ 
formance.  workload,  and  situational  awareness 
between  level  I  and  level  II  interoperability  with 
a  UAS. 

3.  Using  fundamental  systems  analysis  techniques 
such  as  stakeholder  and  functional  analysis  com¬ 
bined  with  Human  Factors  and  Accident  Clas¬ 
sification  and  risk  management  techniques  de¬ 
velop  a  prioritized  list  of  recommended  controls 
to  reduce  the  risk  of  mission  failure  during  coop¬ 
erative  engagements  between  manned  and  un¬ 
manned  aircraft  systems. 

In  coordination  with  Army  Research  Labs  a  separate 
technical  report,  describing  the  method  and  results  of 
the  VUIT-2  experiment,  was  completed  (Hicks  et  al.. 


Fig  7  RACRS  simulator 


2008).  Likewise  an  article  has  been  written  describ¬ 
ing  experimentation  using  VBS2  (Feliciano  and  Sper¬ 
ling.  2008).  The  results  of  these  experiments  will  he 
summarized  in  this  report. 

4  Level  2  (VUIT-2)  Simulation 
Workload  Assessment 

The  West  Point  Operations  Research  Center  worked 
with  the  Army  Research  Lab  Human  Research  En¬ 
gineering  Directorate  to  conduct  a  simulation  exper¬ 
iment  to  measure  the  cognitive  workload  on  Apache 
helicopter  crews  during  cooperative  engagements  us¬ 
ing  the  VUIT-2  system. 

The  simulation  consisted  of  operational  missions  con¬ 
ducted  by  Apache  crews  in  the  Apache  Risk  and  Cost 
Reduction  System  (RACRS)  simulator.  The  RACRS 
Cockpit  consists  of  a  high-fidelity  Apache  cockpit 
with  aircraft  flight  controls.  The  simulator  was  mod¬ 
ified  to  represent  the  UAS  Level  II  functionality  to 
the  maximum  extent  practicable  given  the  maturity 
of  the  Apache  Block  II  design  and  limitations  of  the 
RACRS  simulator.  Four  crews  consisting  of  aviators 
of  varying  levels  of  experience  participated  in  the  sim¬ 
ulation.  After  completion  of  training  in  the  RACRS. 
each  crew  completed  two  missions  in  the  simulator. 

The  operational  scenario  in  the  simulator  replicated 
Soutlnvest  Asia  geographical  features  and  threats. 
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4  LEVEL  2  (VUIT-2)  SIMULATION  WORKLOAD  ASSESSMENT 


During  the  simulation,  crew  actions  within  the  cock¬ 
pit  were  recorded  for  post-test  analysis.  Video 
recordings  of  each  crew  station  and  all  displays  were 
kept  as  a  permanent  record.  Log  files  recorded  all 
button  and  switch  activations  as  well  as  recorded 
which  MPD  display  was  selected  on  each  of  the  MPDs 
during  the  test.  An  eye  tracker  system  was  installed 
in  the  CPG  cockpit  to  record  that  crew  members 
visual  gaze  and  dwell  times.  This  system  provided 
highly  detailed  information  on  the  visual  orientation 
of  the  test  subject.  After  each  simulated  mission,  the 
crew  members  were  subjected  to  a  detailed  interview 
and  completed  a  questionnaire  battery.  The  informa¬ 
tion  gathered  from  all  of  these  sources  provided  a  full 
picture  of  crew  workload  during  the  mission. 


4.1  Crew  Workload 

Pilots  reported  that  they  typically  experienced  toler¬ 
able  workload  when  performing  missions  while  con¬ 
trolling  the  UAS.  They  reported  that  the  workload 
they  experienced  was  comparable  to  workload  they 
experience  during  ‘non-UAS’*  missions  (TADS  and/or 
FCR  only).  They  commented  that  having  to  inter¬ 
act  with  an  additional  sensor  (UAS  sensor)  increased 
their  overall  task  workload,  but  the  SA  provided  by 
the  UAS  sensor  decreased  the  workload  required  to 
detect  and  engage  targets  and  decreased  overall  tar¬ 
get  engagement  timelines.  Subject  matter  experts 
(SMEs)  reported  that  the  pilots  typically  experienced 
tolerable  workload  when  controlling  the  UAS  dur¬ 
ing  missions,  but  had  reduced  spare  workload  capac¬ 
ity.  The  workload  ratings  provided  by  the  pilots  and 
SMEs  were  lower  than  the  Objective  and  Threshold 
workload  ratings  requirements  listed  in  the  Apache 
Block  III  capability  development  document  (Table  1). 


4.2  Crew  Situation  Awareness 

Pilots  typically  experienced  moderate  levels  of  SA 
during  missions.  They  reported  that  they  had  high 
levels  of  SA  of  most  of  the  battlefield  elements  (e.g.. 
threat  location)  during  the  missions.  However,  there 


were  several  instances  when  they  flew  near  the  tar¬ 
gets  and  fired  missiles  outside  of  the  aircraft/UAS 
constraints.  This  was  likely  caused  by  the  lack  of 
extensive  training  and  experience  with  the  UAS  and 
the  need  for  improved  cueing  symbology  to  help  pi¬ 
lots  understand  where  their  aircraft  and  the  UAS  are 
located  in  reference  to  the  targets.  The  pilots  stated 
that  they  had  higher  SA  during  VUIT-2  missions  (vs. 
non-U  AS  missions)  mostly  because  of  the  ‘God’s  Eyet 
view  that  the  UAS  sensor  video  provided  during  mis¬ 
sions.  The  UAS  sensor  video  also  gave  the  pilots  good 
SA  earlier  in  the  mission  (vs.  non-UAS  missions)  be¬ 
cause  they  often  received  the  video  prior  to  (or  just 
after)  take-off  of  their  aircraft.  The  SMEs  reported 
that  the  aircrews  typically  had  adequate  levels  of  SA. 

4.3  Crew  Coordination 

The  majority  of  pilots  reported  that  the  required 
level  of  crew  coordination  was  higher  during  UAS 
missions  than  comparable  non-UAS  missions.  They 
commented  that  having  to  manage  an  extra  sensor 
increased  their  workload  and  required  them  to  inter¬ 
act  more  with  the  CPG.  The  CPGs  were  split  on 
whether  having  to  manage  an  extra  sensor  increased 
the  required  level  of  crew  coordination.  The  SMEs 
rated  aircrew  coordination  during  most  missions  as 
kGood^  or  'Average*. 

4.4  UAS-Crew  Station  Interface 

The  CPGs  were  generally  indifferent  in  their  ratings 
of  the  UAS-Crew  Station  Interface  (UCI).  They  re¬ 
ported  that  they  were  able  to  appropriately  operate 
the  switches  and  keypad  to  accomplish  UAS  mis¬ 
sion  tasks,  although  the  current  configuration  was 
not  considered  the  most  efficient  method.  Pilots  com¬ 
mented  that  the  number  of  switch  actuations  per  mis¬ 
sion  was  not  excessive,  felt  that  the  overall  design  of 
the  UCI  somewhat  hindered  them  from  interacting 
with  the  UAS  in  a  timely  manner,  and  reported  that 
the  UCI  contributed  to  some  high  workload  during 
data  entry  procedures  and  symbology  interpretation. 
In  some  instances,  the  buttons  were  considered  too 
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CDD  Bedford  Workload  Rating 
Requirements 

Pilot  Bedford  Workload  Ratings 
for  VUIT-2  Missions 

SME  Bedford  Workload  Ratings 
for  VUIT-2  Missions 

Objective  Req.  -  5.0 

Pilot  -  2.6 

Pilot  -  2.5 

Threshold  Req  -  6.0 

Co-Pilot/Gunner  -  3.3 

Co-Pilot/Gunner  -  3.9 

Tab.  1  Pilot  workload  requirements  and  ratings. 


small  to  manipulate  quickly  and  remembering  their 
appropriate  functions  was  difficult.  The  functional¬ 
ity  of  the  keypad  also  caused  an  increase  in  time  and 
workload  during  some  missions.  All  of  the  pilots  re¬ 
ported  that  the  symbology  presented  was  difficult  to 
understand. 

The  pilots  recommended  that  several  enhancements 
be  made  to  improve  the  UAS  crew  station  interface, 
and  overall  operation.  The  pilots  commented  that 
with  several  enhancements  and  more  experience  us¬ 
ing  the  system,  most  of  the  increased  workload  and 
decreased  efficiency  could  be  improved.  Following  are 
the  key  improvements  that  the  pilots  recommended 
should  be  made: 

1.  The  symbology  was  very  hard  to  see  on  our 
MPD.  The  icons  represented  around  800  meters 
on  the  map  scale,  which  we  used.  It  made  it 
hard  to  tell  where  everything  was  really  at.  You 
could  not  see  the  symbology  which  tells  which 
way  it  was  flying  or  looking.  Recommend  chang¬ 
ing  the  symbology  and  color  to  indicate  appro¬ 
priate  flight  information  and  line  of  sight  for  the 

UAS. 

2.  Not  having  a  back  arrow  or  a  dedicated  “en¬ 
ter’*  button  on  the  VIP  slows  down  our  ability 
to  quickly  input  the  desired  information.  The 
buttons  are  too  small  for  fast  operation.  There 
needs  to  be  more  streamlined  setup  like  a  com¬ 
puter  keyboard.  “Just  use  the  KU”  keyboard 
unit  in  the  aircraft  now. 

4.5  VUIT-2  Recommendations 


1.  Address  and  incorporate  the  recommended  im¬ 
provements  (as  appropriate)  provided  by  the  pi¬ 
lots.  TRADOC  Capability  Managers  Office,  and 
Aviation  Technical  Test  Center.  Place  emphasis 
on  the  key  improvements  listed  in  the  experi¬ 
ment’s  technical  report  (Hicks  et  ah,  2008). 

2.  Utilize  the  Crew  Station  Working  Group  to 
address  and  incorporate  the  recommended  im¬ 
provements. 

3.  Upgrade  the  RACRS  simulator  to  make  it  rep¬ 
resentative  of  the  AH-64D  Block  3  design  to  en¬ 
hance  future  simulations. 

4.  Continue  using  the  RACRS  to  help  train  pilots, 
refine  the  UCI  and  techniques,  tactics,  and  pro¬ 
cedures  for  the  Block  2  UAS  integration  (VUIT- 
2). 

5.  Maximize  the  amount  of  pilot  training  for  future 
UAS  evaluations. 

6.  Use  the  same  data  collection  methodology  (e.g.. 
Bedford  (Roscoe  and  Ellis.  1990),  SART  (Tay¬ 
lor.  1989))  during  future  simulations  and  tests 
for  Apache  VUIT-2  teaming.  Standardizing  the 
data  collection  methodology  will  help  identify 
changes  that  work  (e.g..  changes  that  reduce 
workload),  identify  areas  that  still  need  more 
work,  and  help  drive  continuous  incremental  im¬ 
provements. 

5  Levels  of  Interoperability 
Low-Resolution  Experiment 


The  following  recoin inendations  are  made  to  enhance  The  RACRS  simulation  used  high-end  simulation 
the  overall  effectiveness  and  suitability  of  the  UAS  technology.  However,  the  experiment  was  expen- 
VUIT-2  integration  into  the  AH-61D:  sive  with  respect  to  dollars  spent  and  man-hours 
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6  OPERATIONAL  RISK  ANALYSIS 


(Sperling  and  Hicks.  2008).  To  help  the  Army  in 
its  research  of  cooperative  engagements  between  a 
UAS  and  a  manned  aircraft,  a  similar  experiment 
was  conducted  using  undergraduate  students  (West 
Point  Cadets)  in  a  lower  resolution  environment  (Fe¬ 
liciano  and  Sperling.  2008).  During  the  experiment 
cadets  were  asked  to  react  and  respond  to  different 
situations  in  a  helicopter  simulation  combat  scenario; 
their  performance,  workload,  and  situational  aware¬ 
ness  were  recorded  after  each  scenario. 

This  research  focuses  on  the  differences  between  level 
I  and  level  II  interoperability.  The  experiment  was 
designed  for  execution  in  the  combat  simulation  lab 
of  the  Department  of  Systems  Engineering  at  the 
United  States  Military  Academy.  The  software  used 
was  Virtual  Battlespace  2  (VBS2*).  The  results  of 
this  project  will  help  determine  whether  a  lower 
resolution  and  less  expensive  environment  can  val¬ 
idate  experimental  results  obtained  using  a  much 
higher  resolution  and  more  expensive  environment 
such  as  the  RACRS.  Through  subjective  and  objec¬ 
tive  measures  this  experiment  was  designed  to  iden¬ 
tify  whether  there  are  significant  differences  in  a  pi¬ 
lots  performance,  workload,  and  situational  aware¬ 
ness  between  level  I  and  level  II  interoperability  be¬ 
tween  a  manned  aircraft  and  a  UAS.  Figure  8  repre¬ 
sents  the  deliberate  attack  mission  used  for  this  ex¬ 
periment. 

Level  I:  Subjects  conducted  a  combat  helicopter  sim¬ 
ulation.  from  a  single  computer  screen,  with  the  basic 
Operations  Order  (OPORD).  They  were  given  verbal 
reports  of  UAS  reconnaissance.  Performance  mea¬ 
sures.  workload  of  tasks,  and  situational  awareness 
of  battlefield  elements  were  recorded. 

Level  II:  Subjects  conducted  a  combat  helicopter  sim¬ 
ulation.  from  a  single  computer  screen,  with  the  basic 
OPORD.  They  were  given  verbal  reports  of  UAS  re¬ 
connaissance  and  a  visual  system  providing  a  real¬ 
time  payload  video.  The  researcher  used  a  com¬ 
puter  nearby  and  provided  subject  with  verbal  and 
visual  intelligence  from  a  computer  screen  (See  Fig¬ 
ure  9).  Performance  measures,  workload  of  tasks, 
and  situational  awareness  of  battlefield  elements  were 
recorded. 


The  low  resolution  experiment  using  Virtual  Bat¬ 
tlespace  2  (VBS2^)  mirrored  the  VUIT-2  experiment 
in  tactical  scenario  and  metrics  of  performance,  work¬ 
load  and  situational  awareness.  The  results  indicated 
that  when  the  subjects  had  access  to  live  video  feed 
from  the  UAS: 

•  Performance  generally  stayed  constant  between 
conditions,  but  in  one  case  increased;  this  was 
displayed  by  a  statistically  significant  decrease 
in  the  number  of  vehicles  the  subjects  did  not 
engage  throughout  the  scenarios. 

•  Workload  decreased  during  a  number  of  phases 
of  the  scenarios:  this  was  shown  by  a  decrease  in 
the  Bedford  workload  scale  during  the  following 
phases  of  each  operation: 

-  Target  detection 

-  Identification  of  allied  and  threat  equip¬ 
ment 

—  Actions  on  contact,  and 

—  Movement  to  contact 

•  Situational  awareness  (SA)  generally  stayed  con¬ 
stant  between  conditions.  But  in  two  cases  SA 
increased:  this  was  shown  by  a  statistically  sig¬ 
nificant  increase  in  SA  in  two  phases  of  the  op¬ 
eration:  Location  of  enemy  units,  and  location 
of  non-combatants. 

These  results  are  consistent  with  the  findings  of  the 
VUIT-2  experiment.  These  results  indicate  that  ex¬ 
perimentation  using  low  resolution  simulation  can 
replicate  that  of  a  high  resolution  experiment,  such 
as  the  RACRS  simulation,  yet  be  much  more  cost  ef¬ 
fective.  This  finding  could  also  be  transferred  to  the 
training  domain. 

6  Operational  Risk  Analysis 

The  system  of  systems  being  investigated,  cooper¬ 
ative  engagements,  is  currently  operating  in  four 
stages  of  its  lifecycle.  This  introduces  additional  risk 
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Fig.  9  Low- resolution  experimental  setup. 
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inlo  an  already  complex  system.  Generally,  the  risk 
that  is  addressed  in  Uhs  effort  is  operational  risk:  one 
of  (he  least  quantified  and  less  understood.  Opera¬ 
tional  risk  addresses  the  likelihood  and  severity  of 
consequences  during  the  operational  stage  of  the  sys¬ 
tem  lift'  cycle  (Parnell  et  ah.  2008).  This  research 
specifically  considers  operational  risk  as  the  risk  to 
the  success  of  a  cooperative  engagement  mission  be¬ 
tween  a  manned  arid  unmanned  system.  The  goal  of 
this  portion  of  the  research  was  to  develop  a  list  of 
operational  risk  mitigation  controls  and  present  them 
to  the  client  in  a  prioritized  manner  based  on  the  dif¬ 
ficulty  of  implementation  of  the  control  versus  the 
reduction  in  risk. 

6.1  Method 

\  systematic  and  t  horough  risk  assessment  was  nec¬ 
essary  to  identify  as  many  risks  to  the  system  as  pos¬ 
sible'.  Complete  risk  assessment,  such  as  required  for 
this  research,  consists  of  these  seven  parts: 

•  Identification  of  the  risk  that  is  to  be  analyzed 
and  potentially  controlled. 

•  \  qualitative  description  of  the  risk:  why  it 
might  happen,  events  that  would  make  it  more  or 
less  likely  to  occur  or  may  increase  or  decrease 
the  subsequent  impact  should  the  event  occur, 
and  possible  actions  to  take  that  might  reduce 
the  risk  effectively. 

•  \  semi-quantitative  or  quantitative  assessment 
of  the  risk 

•  Development  of  risk  management  options  (hat 
are  available. 

•  Selection  of  the  most  effective  and  efficient  risk 
management  options 

•  Implementing  the  approved  risk  management 
plan. 

•  Communicating  the  plan  and  its  basis  to  all  rel¬ 
evant  stakeholder's  (Parnell  et  ah,  2008). 


Fig.  11  LTC  Sperling  interviews  I  \S  operators  in 
Iraq. 

The  means  by  which  this  risk  assessment  was  con¬ 
ducted  was  through  the  employment  of  various  fun¬ 
damental  and  advanced  systems  analysis  techniques 
(Figure?  10). 

•  Stakeholder  analysis 

•  Functional  hierar  chy  development 

•  Human  Factors  Analysis  and  Classification  Sys¬ 
tem  (HFACS)  analysis 

Identification  of  operational  risk  events 

•  Determination  of  Risk  of  each  event 

Probability 
-  Severity 

•  Development  of  controls  across  DOTMLPF 

•  Scoring  of  cont  rols 

•  Sensitivity  analysis 
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Fig.  10:  Operational  risk  assessment  methodology. 
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6.2  Stakeholder  Analysis 

Stakeholder  analysis  initiated  this  effort,  but  never 
truly  ended.  Stakeholders  comprise  the  set  of  in¬ 
dividuals  and  organizations  that  have  a  vested  in¬ 
terest  in  the  problem  and  its  solution  (Sage  and 
Armstrong,  2000).  A  thorough  stakeholder  analy¬ 
sis  was  essential  to  obtain  a  clear  problem  defini¬ 
tion  and  was  critical  to  the  success  of  this  project. 
Various  stakeholder  opinions  were  elicited  through 
interviews,  focus  groups,  surveys  and  observation 
throughout  this  process  at  different  levels  within  the 
system  and  for  different  purposes.  Initially  high  level 
management  was  assessed  in  order  to  establish  the 
width  and  breadth  of  the  problem.  Throughout  the 
rest  of  the  process  mid-level  management  and  user 
level  stakeholders  were  the  primary  focus  to  estab¬ 
lish  functions  of  the  system,  operational  risk  events, 
their  associated  probabilities  and  severities,  and  pos¬ 
sible  controls  along  with  their  associated  cost  and 
benefit.  The  most  valuable  assessments  were  con¬ 
ducted  in  Afghanistan  and  Iraq  where  the  leadership 
of  two  Combat  Aviation  Brigades,  five  Brigade  Com¬ 
bat  Teams,  two  Task  Forces,  and  11  of  the  22  Shadow 
platoons  were  assessed  (Figure  12). 

The  problem  definition  matrix  shown  in  Figure  13 
was  used  to  organize  some  of  the  stakeholders*  pri¬ 
mary  concerns  by  environmental  factors  surrounding 
and  embedded  in  the  system.  This  method  ('an  lead 
the  analyst  in  a  more  fruitful  direction  when  assessing 
a  new  stakeholders.  Furthermore,  it  helps  establish 
relationships  between  stakeholders. 

6.3  Functional  Analysis 

Once  the  stakeholder  analysis  and  problem  definition 
framework  were  complete,  a  functional  analysis  was 
used  to  organize  into  a  hierarchy  the  functions  that 
must  occur  on  the  battlefield  for  a  successful  coopera¬ 
tive  engagement  to  take  place.  These  functions  all  fall 
into  one  of  three  categories  -  coordinate,  communi¬ 
cate,  and  perform  actions  on  contact.  It  is  important 
to  note  that  for  successful  cooperative  engagements, 
the  functions  are  not  confined  to  only  UAS  systems 


or  helicopters.  They  must  be  performed  by  the  entire 
ground-air  team  to  include  units  on  the  ground  and 
the  command  and  control  nodes  responsible  for  thorn 
(Figure  14). 

6.4  Human  Factors  Analysis  and 
Classification  System 

Considering  the  functions  identified  in  the  func¬ 
tional  analysis,  the  stakeholders  were  asked  about  the 
things  that  could  possibly  go  wrong  in  the  conduct  of 
cooperative  engagements.  There  were  considered  po¬ 
tential  risks  to  successful  completion  of  the  mission 
-  operational  risks.  These  risks  were  elicited  from 
stakeholders  during  interview  sessions,  and  they  were 
further  refined  by  the  analysis  team  once  the  list  had 
been  compiled.  The  Human  Factors  Analysis  and 
Classification  System  (HFACS).  originally  conceived 
as  a  framework  for  safety  assessments,  was  used  to 
elicit  risks  (Shappell  and  Wiegman.  2000).  It  includes 
risk  identification  in  the  following  areas: 

•  Organizational  factors 

Inappropriate  organizational  struc¬ 
ture/manning 

—  Inadequate  promotion  policies 
Inappropriate  culture 

•  Inadequate  supervision 

-  Deficient  training  program 

—  Failure  to  provide  operational  doctrine 
Failure  to  correct  inappropriate  behavior 

Improper  work  tempo  (risk  without  bene- 

fit) 

•  Preconditions 

-  Poor  team  work/tearn  resource  manage¬ 
ment 

—  Loss  of  situational  awareness 

—  Improper  briefing  before  an  operation 
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Client 
PM  Apache 
PM  UAS 

Apache  Block  III  PM 
Apache  Block  Vuit-2  PM 


Users/Consumers:  OEF:  OIF: 

1-101  Attack  Bn  173rd  Airborne  TF  Bayonet  2/25thBCT 

3-159th  Attack  BN,  2-17  CAV  TF  Outfront  3/4th  BCT 

UAS  Training  Bn  101st  CAB  2 /3rd  BCT 

DES  4/3rd  BCT 

Shadow  PM  12th  CAB 


Fig  12:  Cooperative  engagement  stakeholders. 
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Fig.  13:  Problem  definition  matrix. 
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Fig.  14:  Functional  analysis  for  cooperative  engagements. 


•  Actions  during  (lie  operation 

—  Mi  sidenti  float  ion  of  target 

—  Did  not  communicate  all  needed  informa¬ 
tion 

—  Failed  to  recognize  extremes 

By  the  HCACS  framework,  mission  failure  can  be 
caused  by  a  risk  factor  in  any  one  of  the  cate¬ 
gories.  However,  failure  often  stems  from  an  unfor¬ 
tunate  alignment  of  multiple  risks,  cutting  across  all 
of  the  categories.  In  a  safety  framework,  accidents 
often  have  multiple  related  causes.  In  an  operational 
framework,  mission  failure  often  stems  from  multiple 
deficiencies.  This  analysis  seeks  to  identify  as  many 
of  these  factors  as  possible  so  that  mitigating  actions 
may  be  taken  to  reduce  or  eliminate  as  many  of  these 
risks  as  possible. 

6.5  Risk  Scoring 

All  risks  are  not  equal.  Some  are  more  serious 
than  others.  The  US  \rrny  has  developed  a  two¬ 


dimensional  risk  assessment  framework  that,  catego¬ 
rizes  risks  based  on  both  probability  ans  severity  (De¬ 
partment  of  the  Army.  199S)  as  illustrated  in  Figure 
15.  The  severity  of  the  risk  is  grouped  into  the  fol¬ 
lowing  categories: 

CATASTROPHIC  (I)  -  Loss  of  ability  to  accomplish 
the  mission  or  mission  failure.  Death  or 
permanent  total  disability  (accident  risk). 
Loss  of  major  or  mission-critical  system 
or  equipment.  Major  property  (facility") 
damage.  Severe  environmental  damage. 
Mission-critical  security"  failure.  Unac¬ 
ceptable  collateral  damage. 

CRITICAL  (II)  -  Significantly  (severely)  degraded 
mission  capability  or  unit  readiness.  Per¬ 
manent  partial  disability,  temporary  total 
disability  exceeding  3  months  time  (acci¬ 
dent  risk).  Extensive  (major)  damage  to 
equipment  or  systems.  Significant,  dam¬ 
age  to  property  or  the  environment.  Se¬ 
curity  failure.  Significant  collateral  dam¬ 
age. 
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Risk  Auess merit  Matrix 
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Negligible 

IV 

W 

E  Extremely  High  Risk 
H  High  Risk 

M  Moderate  Risk 
L  Low  Risk 

Fig.  15:  Risk  assessment  matrix. 

MARGINAL  (III)  -  Degraded  mission  capability  or 
unit  readiness.  Minor  damage  to  equip¬ 
ment  or  systems,  property,  or  the  envi¬ 
ronment.  Lost  day  due  to  injury  or  illness 
not  exceeding  3  months  (accident  risk). 
Minor  damage  to  property  or  the  envi¬ 
ronment. 

NEGLIGIBLE  (IV”)  -  Lillie  or  no  adverse  impact 
oil  mission  capability.  First  aid  or  minor 
medical  treatment  (accident  risk).  Slight 
equipment  or  system  damage,  but  fully 
functional  and  serviceable?.  Little  or  no 
property  oi  environmental  damage?. 

In  addition,  the'  probability  of  the  risk  factor  is  taken 

into  account : 

FREQUENT  (A)  Occurs  very  often,  continuously 
experienced 

LIKELY  (B)  Occurs  several  times 

OCCASIONAL  (0)  Occurs  sporadically 

SELDOM  (D)  Remotely  possible;  could  occur  at 
some1  time 

UNLIKELY  (E)  Can  assume  will  not  occur,  but  not 
impossible 

Figure  16  shows  the  results  of  risk  identification  and 

scoring  for  cooperat  ive  engagements. 


6.6  Controls 

Once  the  risks  had  been  identified  and  scored,  the 
analysis  team  worked  with  the  stakeholders  to  brain¬ 
storm  a  list  of  controls  -  those  actions  that  could 
be  taken  to  eliminate  or  mitigate  the  identified 
risks.  These  controls  span  doctrine,  organization, 
training,  materiel,  logistics,  personnel,  and  facili¬ 
ties  (DOTMLPF).  Those  controls  are  listed  in  Table' 
2.  Each  control  mechanism  was  scored  on  a  two- 
dimensional  scale.  The  first  factor  is  a  risk  reduction 
score.  This  score  was  a  weighted  sum  of  the  control's 
ability  to  mitigate'  each  risk  factor  wlie'ie'  the'  weight 
is  based  em  the'  risk  category.  The'  second  score'  is  a 
subjective'  ranking  e)f  the'  difficulty  of  implementation 
for  the  controls.  These  results  are  plotted  in  Figure 
17  where  the  factors  circle?ei  in  given  re'presonl  low- 
hanging  fruit.  These;  controls  can  be'  implcnu'ntcd 
relatively  easily  with  a  significant  reductieui  in  over¬ 
all  risk.  The  coiitre>ls  in  yellow  represent  a  sevonel  tie'i 
where  implementation  involve*;  significant  effort,  and 
the  overall  risk  reduction  is  not  as  great.  Finally, 
those  factors  circled  in  red  represent  controls  that 
are  very  difficult  to  implement  with  only  a  marginal 
risk  reduction.  Implementation  of  these  is  not  rev- 
om  mended. 

6.7  Results. 

Based  on  the  scoring  of  controls,  the'  results  of  this 
studv  fall  into  throe  e:ategories.  Ree’omrnendations 
should  be?  strongly  considered  for  implementation. 
Considerations  should  be?  furthe'r  analv/e'd  for  pos¬ 
sible'  impIe?me;ntation.  Finally,  honorable'  nu'ntions 
should  be  assessed  in  the  e’onte'xt  of  othe'i  informa¬ 
tion,  be?yond  the  scope  of  this  st.uely.  before'  consiele'r- 
ing  action. 

6.7.1  Recommendations 

Deployable  Virtual  Training  Environment 
(DVTE)  for  Training  (Control  #10).  De  ve  lop  a 
simulation  capability  for  rollevfive  training  in  coop¬ 
erative  engagements  similar  to  the  Marine's’  DYTE. 
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Fig.  16:  Risk  factors  for  successful  cooperative  engagements. 
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Fig.  17:  Scoring  of  the  DOTMLPF  controls.  See  Table1  2  for  a  listing  of  controls  plotted  here'. 


This  is  a  laptop-based  system  designed  to  be  light 
and  deployable  so  that  Marines  can  do  small  unit 
combined  arms  collective  training  in  austere  environ¬ 
ments  at  the  unit  level  (Office  of  Naval  Research. 
2007).  It  is  composed  of  existing  commercial  and 
government-owned  technology  and  is  hosted  on  a 
self-contained  network  of  easily  configurable  laptop 
computers.  It  contains  an  emulation  of  a  tactical 
communications  network  and  provides?  a  state-of-the- 
art  after  action  review  capability.  This  capability 
would  allow  Apache  pilots  and  UAS  operators  to 
work  together  to  develop  st  andard  operating  proce¬ 
dures  (SOPs)  and  coordination  mechanisms  for  coop¬ 
erative  engagements.  This  training  capability  would 
address  many  of  the  risk  factors  identified  in  this 
study,  and.  because  a  Marine  system  of  similar  ca¬ 
pabilities  already  exists,  adaptation  to  an  Army  ca¬ 
pability  would  not  be  as  difficult:  and  building  a  sys¬ 
tem  from  scratch.  The  West  Point  Operations  Re¬ 
search  Center  will  conduct,  a  follow-on  study  in  order 
to  further  develop  the  requirement  s  and  potential  ap¬ 


proaches  to  achieving  this  capability. 

Standards  and  Leadership  (Control  #21).  \s- 
sessments  from  the  stakeholder  analysis  and  func¬ 
tional  analysis  process  showed  that  some  I  \S  units 
operated  without  clear  standards  or  a  clear  mandate' 
to  follow  those  standards  using  pre-flight  and  pre- 
operations  checklists  and  oilier  aids.  This  is  a  prob¬ 
lem  that  could  be  easily  fixed  by  the  leadership  of 
UAS  units,  and  it  would  have  a  significant  impact  on 
successful  cooperative  engagements  in  theater. 

Loader’s  Guide  (Control  #18)  Develop  a 
leader's  guide  for  cooperative  engagements.  This 
guide  would  provide  essential  information  about  ex¬ 
pectations  that,  a  commander  may  have  regarding 
manned  unmanned  cooperative  engagements  in  the 
operational  environment.  This  handbook  is  intended 
as  a  quick-reference  for  military  commanders  at 
brigade-level  and  below  to  employ  this  unique  asset. 
Tin1  West  Point  Operations  Research  Center  will  con¬ 
duct  a  follow-on  study  to  draft  an  initial  version  of 
this  leader’s  guide. 
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Controls 

1  Joint  Pub 

2  IFR 

3  Natl  Airspace 

4  Doctrine  Developers 

5  UAS  under  CAfi 

6  AVNWO 

7  BAEs 

8  UAS  mix  CAaDfv 

9  Army  Control 

10  DVTE 

11  BCTSlm 

12  Scftooihouse 

13  VUIT-2 101st 

14  Arming  UAS 

15  Decision  Support  Tool 

16  Platoon/CO  OSRVTs 

1 7  VUIT *2  digital  recorder 

18  Leader's  Guide 

19  MTTs 

20  Pre-Command  Course 

21  Standards-leadership 

22  CRC 

23  ERMP  Pax  before  system 

24  AMP  system 

25  29  Pax  Platoon 

26  Qualified  Operators 

27  ASI  on  USR 


Tab.  2  List  of  DOTMLPF  controls. 


Mobile  Training  Teams  (MTTs)  (Control 
#19).  Employ  Mobile  Training  Teams  to  brief  in- 
t  heater  leadership  on  capabilities  and  procedure's. 
The  target  audience  is  brigade  and  battalion  com¬ 
manders  and  staif.  These  teams  would  also  be  able 
to  work  with  units  in  their  pre-deployment  training 
cycle. 

Organize  UAS  under  the  combat  aviation 
brigade  (CAB)  (Control  #5).  Organize  Y  \S 
under  general  support  aviation  brigade  (GSAB)  for 
staff,  safety,  standardization,  and  maintenance  sup¬ 
port.  UAS  would  still  task  organize  and  operate 
as  the  tactical  situation  dictates.  For  example,  the 
ground  control  station  would  still  be  able  to  co-locate 
with  the  brigade  combat  team,  but  the  launch  teams 
could  be  consolidated  at  the  GSAB.  This  reduces  the 
number  of  single-point  failures  and  prevents  situa¬ 
tions  where  platoons  operate  alone  with  onK  one  or 
two  maintainors.  During  stakeholder  interviews,  the 
commander  of  1-3  BCT  was.  “...not  in  favor  of  consol¬ 
idation  at  first L.  but  I  have  seen  no  negative  impact  on 
mission  support,  what  we  have  gained  is  economy  of 
force."  According  to  his  operations  officer.  4  A  Ye  have 
actually  had  extra  support  when  needed.  * 

6.7.2  Considerations 

Decision  Support  Tools  for  GCS  Operators 
(Control  #15).  Develop  decision  support  and  com¬ 
puter  aided  tools  to  improve  t  he  efficiency  and  effec¬ 
tiveness  of  ground  control  station  crews.  Currently 
planned  improvements  will  allow  the  pilot  to  operate' 
more  than  one  aircraft .  However,  it  would  be  very  dif¬ 
ficult  for  the  payload  operator  to  monitor  more  than 
one  sensor.  This  is  where  some  automation  would  be 
most  useful. 

BCT  Level  Simulation  Training  (Control 
#11).  Expand  the  simulation  concept  addressed 
with  DVTE  (Control  #10)  to  include  brigade  and 
battalion  training  for  the  staffs  and  commanders  that 
must  plan,  allocate,  and  execute  handoff  for  cooper¬ 
ative  engagements.  This  training  capability  would 
have  to  be  integrated  with  simulation  tools  and  pro¬ 
cesses  currently  used  for  BCT  training.  Virtual  sit¬ 
uational  training  exercises  at  the  BCT  level  would 
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Fig  18  BCT  level  TOC  where  cooperative  engage¬ 
ments  an'  oft  ('n  coordinated* 

address  the  training  gap  fur  staffs  that  must  coordi¬ 
nate  and  execute  (  host'  missions.  The  follow-on  st  ndv 
by  the  West  Point  Operations  Research  Center  will 
address  some  of  t  he  requirements  for  this  capability. 

Aviation  Warrant  Officer  (Control  #6).  As¬ 
sign  an  aviation  warrant  officer  to  U  \S  platoons  as 
a  technical  warrant.  Initial  scrubs  of  accident  data 
show  that  this  would  reduce  the  risk  of  accidents 
and  improve  the  number  of  flying  hours  for  CAS* 
Observations  during  stakeholder  analysis  in  Iraq  and 
Afghanistan  showed  higher  standards  and  better  at¬ 
tention  to  (ietail  when  aviation  warrant  oflieers  were 
employed  in  this  role. 

Install  VUIT-2  on  101st  Aircraft  (Control 
#13).  In  order  to  better  equip  unit  s  for  coopera¬ 
tive  engagements,  install  YCIT-2  equipment  on  the 
aircraft  from  the  101st  Combat  \viation  Brigade  cur¬ 
rently  in  Afghanistan.  These  aircraft  would  remain 
in  theater  as  new  units  fell  in  on  this  equipment  to 
continue  operations. 

6.7.3  Honorable  Mention 

Combat  Readiness  Center  Investigations 
(Control  #22).  Insist  on  Combat  Readiness 
Center  (CRC)  investigations  of  l  AS  accidents. 


ASI  on  USR  (Control  #27).  Insist  on  reporting 
UAS  Additional  Skill  Identifiers  (ASI)  on  the  Unit 
Status  Report  (USR). 

Schoolhouse  Education  (Control  #12).  Im¬ 
prove  UAS  schoolhouse  education  with  respect  to 
weather  effects  on  UAS  flight  and  maintenance1  pro¬ 
cedures,  records,  and  tracking. 

Personnel  (Control  #25).  Man  the  UAS  platoon 
at  20  personnel.  The  number  of  soldiers  is  more  im¬ 
portant  to  successful  l  \S  operations  than  the  num¬ 
ber  of  systems. 

Organization  of  UAS  in  the  Army  (Control 
#9)  Retain  UAS  organizations  in  the  US  Army 
rather  than  outsourcing  this  capability  to  the1  US 
Air  Force.  This  allows  UAS  operator's  to  better 
understand  their  role  in  the  overall  scheme  of  ma¬ 
neuver  and  commander  s  intent.  They  will  be  able 
to  build  habitual  relationships  with  ground  maneu¬ 
ver  units  and  manned  aviation  assets  and  enable 
greater  opportunities  for  coop  ('rat  ive  engagement  and 
m an n ec  1/un t nan n ed  team i n g . 

7  Conclusions 

The  integration  of  Apache  attack  helicopters  with 
I  \S  video  is  a  system  of  systems  integration 
that  provides  a  valuable  capability  to  commanders 
charged  with  counter-insurgency  operations  in  Iraq 
and  Afghanistan.  This  study  has  looked  into  some  of 
the  complex  challenges  that  occur  within  systems  of 
systems  engineering  and  provided  valuable'  feedback 
to  leaders  across  the  aviation,  unmanned  systems, 
acquisition,  and  operations  communities.  It  has  ad¬ 
dressed  the  concern  of  cognitive  overload  for  Apache 
pilots  who  use  the  YlTT-2  system  for  cooperative  en¬ 
gagements.  Conclusions  from  two  independent  stud¬ 
ies  show  a  manageable  cognitive  load  foi  both  the 
pilot  and  co-pilot  gunner.  They  reported  a  reduced 
workload  during  target  identification  due  to  the  over¬ 
head  view  provided  by  the1  UAS.  In  addition  to  the 
cognitive  workload  experiments,  this  study  took  a 
comprehensive  look  into  all  of  t  he  DOTMLPF  fac  tors 
associated  with  successful  cooperative1  engagements. 
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7  CONCLUSIONS 


This  included  a  visit  to  UAS  platoons  and  BCTs  in 
Iraq  and  Afghanistan  currently  conducting  these  mis¬ 
sions.  After  applying  a  risk  management  analysis 
framework  to  these  factors,  some  clear  recommenda¬ 
tions  have  emerged.  The  Operations  Research  Center 
will  conduct  a  follow-on  study  further  investigating 
two  of  these  recommendations.  We  will  determine 
requirements  and  technical  recommendations  for  the 
potential  development  of  a  virtual  training  capability 
for  cooperative  engagements  that  would  allow  UAS 
operators  and  pilots  to  work  together  in  developing 
coordination  measures  and  SOPs  before  deploying  to 
theater.  We  will  also  develop  a  draft  version  of  a 
leaders  guide  for  cooperative  engagements  focused  at 
leaders  at  brigade  and  below  who  employ  these  assets 
in  support  of  operations. 
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Nomenclature 

A2C2S  Army  Airborne  Command  and  Control  Sys- 
tem 

A  AN  Army  After  Next 

ACTD  Advanced  Concept  Technology  Demonstra¬ 
tion 

ADM  Acquisition  Decision  Memorandum 

AIU  Aircraft  Interface  Units 

AMUST  Airborne  Manned/Unmanned  System 

AoA  Analysis  of  Alternatives 

ASI  Additional  Skill  Identifier 

ATD  Advanced  Technology  Demonstration 

AVITS  Apache  Video  and  Image  Transmission  Sys¬ 
tem 

BCT  Brigade  Combat  Team 

BDA  Battle  Damage  Assessment 

CAB  Combat  Aviation  Brigade 

CDD  Capability  Development  Document 

CEP  Concept  Experimental  Program 

CPG  Co-pilot /Gunner 

CRC  Combat  Readiness  Center 

DoD  Department  of  Defense 

DOTMLPF  Doctrine.  Organization.  Training.  Ma¬ 
teriel.  Logistics.  Personnel,  and  Facilities. 

GCS  Ground  Control  Station 

ISR  Intelligence.  Surveillance,  and  Reconnais¬ 
sance 

JPSD  Joint  Precision  Strike  Demonstration 
LCT  Longbow  Crew  Trainer 
MP  Mission  Processors 


MTCDL  Mini-Tactical  Common  Data  Link 

MUM  Man ned/U n man ned 

OPORD  Operations  Order 

PGCS  Portable  Ground  Control  Station 

ROVER  Remote  Operations  Video  Enhanced  Re¬ 
ceiver 

RVT  Remote  Video  Terminal 

SA  Situation  Awareness 

SAG  Studies  and  Analysis  Group 

SME  Subject  Matter  Expert 

SOP  Standard  Operating  Procedure 

TADS  Target  Acquisition  Designation  Sight 

TCDL  Tactical  Common  Data  Link 

TCM  TRADOC  Capabilities  Manager 

TRADOC  Training  and  Doctrine  Command 

TSM  TRADOC  System  Manager 

TUAS  Tactical  Unmanned  Aircraft  System 

UAS  Unmanned  Aircraft  Systems 

UCI  User-Crew  Station  Interface 

USR  Unit  Status  Report 

VBS2  Virtual  Battlespace  2 
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